On states, channels and purification'' 

A. S. Holevo 



Abstract 

In this note we introduce purification for a pair (p, $), where p is a 
quantum state and $ is a channel, which allows in particular a natural 
extension of the properties of related information quantities (mutual and 
coherent informations) to the channels with arbitrary input and output 
spaces. 

Given a state p and a channel $ there are three fundamental entropy quan- 
tities: the input entropy H[p), the output entropy H{^[p\), and the entropy 
exchange H{p,^), the last being defined as ® Id)[|?/'p >< V'pDj where 

\ipp > is a purification of p. From these entropies one derives several information 
quantities of which the mutual information I{p, $) ~ H{p) + H{^[p\) — H{p, $) 
and the coherent information Ic{p, <&) = H{^[p]) — H{p, <i>) are of the main im- 
portance. The quantities /, Ic have a number of useful properties, the standard 
proof of which uses a dynamical representation of the channel $ via interac- 
tion of the system in question with an environment (see e. g. [^). Such 
a representation presupposes that the system preserves its identity during the 
interaction and hence the input and the output spaces of the channel are nec- 
essarily identical too. However from the viewpoint of information theory this 
is quite an unnatural restriction. One of the properties which we use as an 
illustration is the data processing inequality for two channels $1, $2 '■ 

/c(p,$2$l) </c(p,*l). 

It is natural to expect that it holds for arbitrary channels satisfying the only 
restriction that the output of the first channel is equal to the input of the second. 
But using dynamical representations restrict us to the case where both channels 
act in the same space. The present note removes this restriction by introducing 
a new tool: a purification of the couple (p, $), from which all the three entropy 
quantities emerge with equal status. 
Consider the spectral decomposition 
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in the input Hilbert space Tiim the Kraus decomposition of the channel 
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Q = l 



a=l 



where Aa : Tim 'Hout- We introduce the three systems R,Q,E with the 
Hilbert spaces defined as follows: 

'Hb. = Id — 'Hini 'Hq = T^out', 'He = 

where is the standard Hilbert space of n-dimensional vectors and denotes 
unitary equivalence. Consider the tensor product 7i — Ti.R'SiTi.Q'^Ti.E which can 
be realized as the space of vectors \ip >= [ipja] with the components V'jq € 'Hout- 



the elements of 



An operator X iriTi. \s represented by a square matrix 
which are operators in Tiout ■ Partial traces in Ti. are computed according to the 
formulas 



Take the unit vector 
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IV'(p,*) >= 



TrsX 
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and the corresponding pure state fl = |^/'(p,*) >< V'(p,*) L then the partial states 
are 



p; ng^^p]; nE = [TvA^pA*p] , 
therefore 

H{nR) = Hip); i/(r!c3) - Hi^E) ^ Hip,^), 

where the last equality follows from the facts that H{nE) = H{ilRQ) and 

^RQ ^ [V^v/^'J'[|ej >< efc|]] = (Id0$)[|?/'p >< ?/'p|], IV'p [V^|ej >]• 

It also coinsides with the well-known expression for the entropy exchange in the 
dynamical case, see e. g. |^. 

Let us see how this can be used for the proof of the general data processing 
inequality. Let {Aa},{B^} be the components of the Kraus decompositions 
for the channels $i,$2- By using the purification fl^ — |'i/'(p,*i) >< V'(p,*i)l in 
Ti-R® (^Hei we obtain 



h{p,^,) = H{n],^Ej-H{nl,j. 
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For the superposition $2^1 we use the purification 



IV'(p,*2*l) > = 



where = M being the number of the components in the Kraus de- 

composition of $2- If f^^^ is the corresponding pure state, then 



that = ^RE^■ But 



The data processing inequality will follow from strong subadditivity if we show 

^/xJXk < 'ipk\A*0Aa\tpj > , 



while 



M 



which is indeed the same. 

To see that the data processing inequality is not special, and other properties 
can be treated in a similar way, let us establish subadditivity of quantum mutual 
information 

I{pi2, *i O $2) < I{pi, $1) + I{P2, $2)- 

Let be the purifying states for the corresponding systems, con- 

structed according to the recepee above. Then in obviuos notations the in- 
equality becomes 

or, taking into account purifications, 

^(^QiQ2-EiiJ2) + ^(^QiQ2) ~ ^i^EiE^) 

This again will follow from repeated use of strong subadditivity and from sub- 
additivity of H(^Iq^q^) if we show that 
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But the first equality just means that 

" M 

and similarly the second. 

Let us make some general remarks. Unlike the case of dynamical represen- 
tation of the channels, where one considers the "in" systems R,Q,E and the 
"out" systems R',Q',E' etc., here we have only the "out" systems with R be- 
ing identical to the input of Q so there is no sense in "primed" notations. As 
in other cases, we observe a kind of complementarity between statistical and 
dynamical aspects of quantum description: our purification is "less physical" in 
that it does not admit a dynamical interpretation, but it is more relevant to 
the statistical structure related to the pair (p, $) since it does not involve any 
arbitrariness from outside. 
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